Multitask Detection of Speaker Changes, Overlapping Speech and Voice Activity Using wav2vec 2.0

Self-supervised learning approaches have lately achieved great success on a broad spectrum of machine learning problems. In the field of speech processing, one of the most successful recent self-supervised models is wav2vec 2.0. In this paper, we explore the effectiveness of this model on three basic speech classification tasks: speaker change detection, overlapped speech detection, and voice activity detection. First, we concentrate on only one task -- speaker change detection -- where our proposed system surpasses the previously reported results on four different corpora, and achieves comparable performance even when trained on out-of-domain data from an artificially designed dataset. Then we expand our approach to tackle all three tasks in a single multitask system with state-of-the-art performance on the AMI corpus. The implementation of the algorithms in this paper is publicly available at https://github.com/mkunes/w2v2_audioFrameClassification.Comment: To appear at ICASSP 202

Detection of Prosodic Boundaries in Speech Using Wav2Vec 2.0

Prosodic boundaries in speech are of great relevance to both speech synthesis and audio annotation. In this paper, we apply the wav2vec 2.0 framework to the task of detecting these boundaries in speech signal, using only acoustic information. We test the approach on a set of recordings of Czech broadcast news, labeled by phonetic experts, and compare it to an existing text-based predictor, which uses the transcripts of the same data. Despite using a relatively small amount of labeled data, the wav2vec2 model achieves an accuracy of 94% and F1 measure of 83% on within-sentence prosodic boundaries (or 95% and 89% on all prosodic boundaries), outperforming the text-based approach. However, by combining the outputs of the two different models we can improve the results even further.Comment: This preprint is a pre-review version of the paper and does not contain any post-submission improvements or corrections. The Version of Record of this contribution is published in the proceedings of the International Conference on Text, Speech, and Dialogue (TSD 2022), LNAI volume 13502, and is available online at https://doi.org/10.1007/978-3-031-16270-1_3

Speaker Diarization

Disertační práce se zaměřuje na téma diarizace řečníků, což je úloha zpracování řeči typicky charakterizovaná otázkou "Kdo kdy mluví?". Práce se také zabývá související úlohou detekce překrývající se řeči, která je velmi relevantní pro diarizaci. Teoretická část práce poskytuje přehled existujících metod diarizace řečníků, a to jak těch offline, tak online, a přibližuje několik problematických oblastí, které byly identifikovány v rané fázi autorčina výzkumu. V práci je také předloženo rozsáhlé srovnání existujících systémů se zaměřením na jejich uváděné výsledky. Jedna kapitola se také zaměřuje na téma překrývající se řeči a na metody její detekce. Experimentální část práce předkládá praktické výstupy, kterých bylo dosaženo. Experimenty s diarizací se zaměřovaly zejména na online systém založený na GMM a na i-vektorový systém, který měl offline i online varianty. Závěrečná sekce experimentů také přibližuje nově navrženou metodu pro detekci překrývající se řeči, která je založena na konvoluční neuronové síti.ObhájenoThe thesis focuses on the topic of speaker diarization, a speech processing task that is commonly characterized as the question "Who speaks when?". It also addresses the related task of overlapping speech detection, which is very relevant for diarization. The theoretical part of the thesis provides an overview of existing diarization approaches, both offline and online, and discusses some of the problematic areas which were identified in early stages of the author's research. The thesis also includes an extensive comparison of existing diarization systems, with focus on their reported performance. One chapter is also dedicated to the topic of overlapping speech and the methods of its detection. The experimental part of the thesis then presents the work which has been done on speaker diarization, which was focused mostly on a GMM-based online diarization system and an i-vector based system with both offline and online variants. The final section also details a newly proposed approach for detecting overlapping speech using a convolutional neural network

WHO European Childhood Obesity Surveillance Initiative: associations between sleep duration, screen time and food consumption frequencies

BACKGROUND: Both sleep duration and screen time have been suggested to affect children's diet, although in different directions and presumably through different pathways. The present cross-sectional study aimed to simultaneously investigate the associations between sleep duration, screen time and food consumption frequencies in children. METHODS: The analysis was based on 10 453 children aged 6-9 years from five European countries that participated in the World Health Organization European Childhood Obesity Surveillance Initiative. Logistic multilevel models were used to assess associations of parent-reported screen time as well as sleep duration (exposure variables) with consumption frequencies of 16 food items (outcome variables). All models were adjusted for age, sex, outdoor play time, maximum educational level of parents and sleep duration or screen time, depending on the exposure under investigation. RESULTS: One additional hour of screen time was associated with increased consumption frequencies of 'soft drinks containing sugar' (1.28 [1.19;1.39]; odds ratio and 99% confidence interval), 'diet/light soft drinks' (1.21 [1.14;1.29]), 'flavoured milk' (1.18 [1.08;1.28]), 'candy bars or chocolate' (1.31 [1.22;1.40]), 'biscuits, cakes, doughnuts or pies' (1.22 [1.14;1.30]), 'potato chips (crisps), corn chips, popcorn or peanuts' (1.32 [1.20;1.45]), 'pizza, French fries (chips), hamburgers'(1.30 [1.18;1.43]) and with a reduced consumption frequency of 'vegetables (excluding potatoes)' (0.89 [0.83;0.95]) and 'fresh fruits' (0.91 [0.86;0.97]). Conversely, one additional hour of sleep duration was found to be associated with increased consumption frequencies of 'fresh fruits' (1.11 [1.04;1.18]) and 'vegetables (excluding potatoes)' (1.14 [1.07;1.23]). CONCLUSION: The results suggest a potential relation between high screen time exposure and increased consumption frequencies of foods high in fat, free sugar or salt whereas long sleep duration may favourably be related to children's food choices. Both screen time and sleep duration are modifiable behaviours that may be tackled in childhood obesity prevention efforts

WHO European Childhood Obesity Surveillance Initiative: health-risk behaviours on nutrition and physical activity in 6-9-year-old schoolchildren

Objective: To assess to what extent eight behavioural health risks related to breakfast and food consumption and five behavioural health risks related to physical activity, screen time and sleep duration are present among schoolchildren, and to examine whether health-risk behaviours are associated with obesity. Design: Cross-sectional design as part of the WHO European Childhood Obesity Surveillance Initiative (school year 2007/2008). Children’s behavioural data were reported by their parents and children’s weight and height measured by trained fieldworkers. Descriptive statistics and logistic regression analyses were performed. Setting: Primary schools in Bulgaria, Lithuania, Portugal and Sweden; paediatric clinics in the Czech Republic. Subjects: Nationally representative samples of 6–9-year-olds (n 15 643). Results: All thirteen risk behaviours differed statistically significantly across countries. Highest prevalence estimates of risk behaviours were observed in Bulgaria and lowest in Sweden. Not having breakfast daily and spending screen time ≥2 h/d were clearly positively associated with obesity. The same was true for eating ‘foods like pizza, French fries, hamburgers, sausages or meat pies’ >3 d/week and playing outside <1 h/d. Surprisingly, other individual unhealthy eating or less favourable physical activity behaviours showed either no or significant negative associations with obesity. A combination of multiple less favourable physical activity behaviours showed positive associations with obesity, whereas multiple unhealthy eating behaviours combined did not lead to higher odds of obesity. Conclusions: Despite a categorization based on international health recommendations, individual associations of the thirteen health-risk behaviours with obesity were not consistent, whereas presence of multiple physical activity-related risk behaviours was clearly associated with higher odds of obesity

WHO European Childhood Obesity Surveillance Initiative: body mass index and level of overweight among 6-9-year-old children from school year 2007/2008 to school year 2009/2010.

BACKGROUND: The World Health Organization (WHO) Regional Office for Europe has established the Childhood Obesity Surveillance Initiative (COSI) to monitor changes in overweight in primary-school children. The aims of this paper are to present the anthropometric results of COSI Round 2 (2009/2010) and to explore changes in body mass index (BMI) and overweight among children within and across nine countries from school years 2007/2008 to 2009/2010. METHODS: Using cross-sectional nationally representative samples of 6-9-year-olds, BMI, anthropometric Z-scores and overweight prevalence were derived from measured weight and height. Significant changes between rounds were assessed using variance and t-tests analyses. RESULTS: At Round 2, the prevalence of overweight (including obesity; WHO definitions) ranged from 18% to 57% among boys and from 18% to 50% among girls; 6 - 31% of boys and 5 - 21% of girls were obese. Southern European countries had the highest overweight prevalence. Between rounds, the absolute change in mean BMI (range: from -0.4 to +0.3) and BMI-for-age Z-scores (range: from -0.21 to +0.14) varied statistically significantly across countries. The highest significant decrease in BMI-for-age Z-scores was found in countries with higher absolute BMI values and the highest significant increase in countries with lower BMI values. The highest significant decrease in overweight prevalence was observed in Italy, Portugal and Slovenia and the highest significant increase in Latvia and Norway. CONCLUSIONS: Changes in BMI and prevalence of overweight over a two-year period varied significantly among European countries. It may be that countries with higher prevalence of overweight in COSI Round 1 have implemented interventions to try to remedy this situation

Childhood overweight and obesity in Europe: Changes from 2007 to 2017

The Childhood Obesity Surveillance Initiative (COSI) routinely measures height andweight of primary school children aged 6–9 years and calculates overweight andobesity prevalence within the World Health Organization (WHO) European Regionusing a standard methodology. This study examines the trends in the prevalence ofoverweight and obesity from the first round of COSI carried out in 2007/2008 to thelatest of 2015/2017 in 11 European countries in which data were collected for atleast three rounds. In total 303,155 children were measured. In general, the preva-lence of overweight and obesity among boys and girls decreased in countries withhigh prevalence (Southern Europe) and remained stable or slightly increased in North-ern European and Eastern European countries included in the analysis. Among boys, the highest decrease in overweight (including obesity) was observed in Portugal (from40.5% in 2007/2008 to 28.4 in 2015/2017) and in Greece for obesity (from 30.5% in2009/2010 to 21.7% in 2015/2017). Lithuania recorded the strongest increase in theproportion of boys with overweight (from 24.8% to 28.5%) and obesity (from 9.4% to12.2%). The trends were similar for boys and girls in most countries. Several countriesin Europe have successfully implemented policies and interventions to counteract theincrease of overweight and obesity, but there is still much to be done.The authors gratefully acknowledge support through a grant from the Russian Government in the context of the WHO European Office for the Prevention and Control of NCDs. The Ministries of health of Austria, Croatia, Greece, Italy, Malta, Norway, and the Russian Federation provided financial support for the meetings at which the protocol, data collection procedures, and analyses were discussed. Data collection in the countries included in this study was made possible through funding from: Bulgaria: Ministry of Health, National Center of Public Health and Analyses, and WHO Regional Office for Europe; Czechia: WHO grants AZV MZČR 17-31670 A MZČR-RVO EÚ 00023761, World Health Organization Regional Office for Europe, and WHO country office; Greece: International Hellenic University and Hellenic Medical Association for Obesity; Ireland: Health Service Executive; Italy: Ministry of Health and Italian National Institute of Health; Latvia: Ministry of Health and Centre for Disease Prevention and Control; Lithuania: Science Foundation of Lithuanian University of Health Sciences, Lithuanian Science Council, and WHO; Norway: Ministry of Health and Norwegian Institute of Public Health; Portugal: Ministry of Health Institutions, the National Institute of Health, Directorate General of Health, Regional Health Directorates, and the kind technical support from the Center for Studies and Research on Social Dynamics and Health (CEIDSS); Slovenia: Ministry of Education and Science and Sport of the Republic of Slovenia within the SLOfit surveillance system; and Spain: Spanish Agency for Food Safety and Nutrition (AESAN).info:eu-repo/semantics/publishedVersio

WHO European Childhood Obesity Surveillance Initiative: Impact of Type of Clothing Worn during Anthropometric Measurements and Timing of the Survey on Weight and Body Mass Index Outcome Measures in 6–9-Year-Old Children

Background. The World Health Organization European Childhood Obesity Surveillance Initiative (COSI) conducted examinations in 6–9-year-old children from 16 countries in the first two rounds of data collection. Allowing participating countries to adhere to their local legal requirements or adapt to other circumstances required developing a flexible protocol for anthropometric procedures. Objectives. (1) Review intercountry variation in types of clothing worn by children during weight and height measurements, clothes weight adjustments applied, timing of the survey, and duration of data collection; (2) assess the impact of the observed variation in these practices on the children’s weight or body mass index (BMI) outcome measures. Results. The relative difference between countries’ unadjusted and clothes-adjusted prevalence estimates for overweight was 0.3–11.5%; this figure was 1.4–33.3% for BMI-for-age Z-score values. Monthly fluctuations in mean BMI-for-age Z-score values did not show a systematic seasonal effect. The majority of the monthly BMI-for-age Z-score values did not differ statistically within a country; only 1–3 monthly values were statistically different within some countries. Conclusions. The findings of the present study suggest that the built-in flexibility in the COSI protocol concerning the data collection practices addressed in the paper can be kept and thus do not necessitate a revision of the COSI protocol.info:eu-repo/semantics/publishedVersio

Association between characteristics at birth, breastfeeding and obesity in 22 countries: the WHO European Childhood Obesity Surveillance Initiative – COSI 2015/2017

Objectives: It was the aim of this paper to investigate the association of early-life factors, namely breastfeeding, exclusive breastfeeding and birth weight, with obesity among children. ----- Method: Data from 22 participating countries in the WHO European COSI study (round 4: 2015/2017) were collected using cross-sectional, nationally representative samples of 6- to 9-year-olds (n = 100,583). The children's standardized weight and height measurements followed a common WHO protocol. Information on the children's birth weight and breastfeeding practice and duration was collected through a family record form. A multivariate multilevel logistic regression analysis regarding breastfeeding practice (both general and exclusive) and characteristics at birth was performed. ----- Results: The highest prevalence rates of obesity were observed in Spain (17.7%), Malta (17.2%) and Italy (16.8%). A wide between-country disparity in breastfeeding prevalence was found. Tajikistan had the highest percentage of children that were breastfed for ≥6 months (94.4%) and exclusively breastfed for ≥6 months (73.3%). In France, Ireland and Malta, only around 1 in 4 children was breastfed for ≥6 months. Italy and Malta showed the highest prevalence of obesity among children who have never been breastfed (21.2%), followed by Spain (21.0%). The pooled analysis showed that, compared to children who were breastfed for at least 6 months, the odds of being obese were higher among children never breastfed or breastfed for a shorter period, both in case of general (adjusted odds ratio [adjOR] [95% CI] 1.22 [1.16-1.28] and 1.12 [1.07-1.16], respectively) and exclusive breastfeeding (adjOR [95% CI] 1.25 [1.17-1.36] and 1.05 [0.99-1.12], respectively). Higher birth weight was associated with a higher risk of being overweight, which was reported in 11 out of the 22 countries. Bulgaria, Croatia, France, Italy, Poland and Romania showed that children who were preterm at birth had higher odds of being obese, compared to children who were full-term babies. ----- Conclusion: The present work confirms the beneficial effect of breastfeeding against obesity, which was highly increased if children had never been breastfed or had been breastfed for a shorter period. Nevertheless, adoption of exclusive breastfeeding is below global recommendations and far from the target endorsed by the WHO Member States at the World Health Assembly Global Targets for Nutrition of increasing the prevalence of exclusive breastfeeding in the first 6 months up to at least 50% by 2025